Regularized Nonlinear Acceleration
نویسندگان
چکیده
We describe a convergence acceleration technique for generic optimization problems. Our scheme computes estimates of the optimum from a nonlinear average of the iterates produced by any optimization method. The weights in this average are computed via a simple and small linear system, whose solution can be updated online. This acceleration scheme runs in parallel to the base algorithm, providing improved estimates of the solution on the fly, while the original optimization method is running. Numerical experiments are detailed on classical classification problems.
منابع مشابه
Regularized fractional derivatives in Colombeau algebra
The present study aims at indicating the existence and uniqueness result of system in extended colombeau algebra. The Caputo fractional derivative is used for solving the system of ODEs. In addition, Riesz fractional derivative of Colombeau generalized algebra is considered. The purpose of introducing Riesz fractional derivative is regularizing it in Colombeau sense. We also give a solution to...
متن کاملTopological soliton solutions of the some nonlinear partial differential equations
In this paper, we obtained the 1-soliton solutions of the symmetric regularized long wave (SRLW) equation and the (3+1)-dimensional shallow water wave equations. Solitary wave ansatz method is used to carry out the integration of the equations and obtain topological soliton solutions The physical parameters in the soliton solutions are obtained as functions of the dependent coefficients. Note t...
متن کاملSeismic Design of Steel Structures Based on Ductility and Incremental Nonlinear Dynamic Analysis
In this paper a simple tool for seismic design of steel structures for a selected ductility level is presented. For this purpose, a consistent set of earthquakes is selected and sorted based on the maximum acceleration of ground surface. The selected records are applied as the base motion to a single-degree-of-freedom system with strain hardening and the maximum response acceleration is determi...
متن کاملOn the Exact Solution for Nonlinear Partial Differential Equations
In this study, we aim to construct a traveling wave solution for nonlinear partial differential equations. In this regards, a cosine-function method is used to find and generate the exact solutions for three different types of nonlinear partial differential equations such as general regularized long wave equation (GRLW), general Korteweg-de Vries equation (GKDV) and general equal width wave equ...
متن کاملOn the Acceleration of AOS Schemes for Nonlinear Diffusion Filtering
Based on the renowned additive operator splitting (AOS) schemes that ensure equal treatment of all coordinate axis, accelerated AOS schemes for solving regularized Perona-Malik (P-M) equation are presented. These ameliorated AOS schemes are stable unconditionally, consistent with nonlinear parabolic equations under certain circumstance and demonstrate a remarkably economical CPU time. The paper...
متن کامل